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Abstract 

LT codes are modern and efficient mteless forward error correction (FEC) codes with close to channel capacity 
performance. Nevertheless, in intermediate range where the number of received encoded symbols is less than the 
number of source symbols, LT codes have very low recovery rates. 

In this paper, we propose a novel algorithm which significantly increases the intermediate recovery rate 
of LT codes, while it preserves the codes' close to channel capacity performance. To increase the intermediate 
recovery rate, our proposed algorithm rearranges the transmission order of the encoded symbols exploiting their 
structure, their transmission history, and an estimate of the channel's erasure rate. We implement our algorithm for 
conventional LT codes, and numerically evaluate its performance. 

I. Introduction 

LT codes are modem, efficient, and flexible rateless forward error correction (FEC) codes 0] . An LT 
encoder at a source S can potentiaUy generate a limitless number of encoded symbols Ci,i G {0,1,...} 
from k source symbols x = {xi, X2, ■ ■ ■ , Xk}. The decoder at a destination D can successfully recover x 
from any k'j of received encoded symbols, where 7 is the received coding overhead. Let 'jsucc denote 
the required overhead for a successful decoding. Conventional LT codes can achieve z ^ 1 with high 
probability at 'jsucc^ slightly larger than one, where z denotes the ratio of the number of recovered source 
symbols to k at D. Note that, for LT codes, 'jsucc is fixed and known |[T1. 

Each LT code is identified by a degree distribution. In LT encoding, first an encoded symbol degree 
d is chosen from a degree distribution, {fii,i72, • • • ,^k}, where fij is the probability that d = i. This 
degree distribution is also shown by its generator polynomial ^l{y) = Yli=i ^iV^- Next, d x/s are chosen 
uniformly at random from x, and are XORed to generate an encoded symbol q. Let e G [0, 1) denote the 
channel erasure rate. Therefore, S needs to generate on average m = ''J"^^" encoded symbols so that D 
can collect k'jsucc of them for a successful decoding. 

In LT decoding at D, if a newly delivered Cj,i G {1,2,... , m} has degree-one, it can decode one 
Xj,j G {1, 2, . . . , A;}. If the degree of q is larger than one then previously recovered x/s, if any, are 
removed from q to decrease its degree. If the degree of c, is reduced to one, this symbol is similar to a 
new degree-one q. On the other hand, if the remaining degree is larger than one, the symbol is buffered. 
If any new xj is recovered in the previous step, it is removed from the buffered c/s. Hence, some buffered 
Cj's may acquire a degree equal to one, resulting in recovery of further x/s. This procedure is repeated 
iteratively until no more degree-one emerges. 

Intermediate range of LT codes refers to the case where the transmission is still in progress, i.e., 
< 7 < 1 [2J. Since conventional LT codes (l\ are designed to have an almost complete recovery of x 
(z ^ 1) for certain 'jsucc^ > 1j they have low intermediate recovery rates (z ^ 0) at < 7 < 1. However, 
in many applications where partial recovery of the source symbols from the incomplete received encoded 
symbols is still beneficial, intermediate recovery rate becomes important. For instance, in multimedia 
transmission the receiver can play a lower quality of the multimedia contents from the incomplete recovered 
data. This motivates the design of an algorithm to improve the intermediate recovery rate of existing LT 
codes. 
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In order to obtain a high z (as close as possible to 7) in < 7 < 1, each delivered Cj should decode 
(on average) one Xj instead of being buffered. We propose an algorithm to rearrange the transmission 
order of c/s based on their transmission history, structure of each q, and an estimate of e, such that 
each delivered can decode one Xj with high probability. By employing our proposed algorithm, the 
intermediate performance of a given LT code improves significantly, while the recovery rate of x at ^succ 
remains intact. In other words, the code remains capacity achieving similar to its original setup. 

This paper is organized as follows. Section |Il] reviews the exiting work on intermediate performance of 
LT codes. In Section Hill we propose our novel sorting algorithm. Next, Section |IV] reports the performance 
evaluation of our proposed algorithm. Finally, Section |V] concludes the paper. 

II. Related Work 

In ['2'|, Sanghavi has shown that < 7 < 1 and equivalently < z < 1 can be divided into three 
regions of 2; G [0, |], 2; G [|, |], and z G (|, 1). In each region, the upper bound on z for all rateless codes 
versus 7 is formulated, and the optimum f2(?/)'s to gain these upper bounds are provided. The f2(y)'s 
provided for each region perform optimally in that specific region only, thus they have a low z compared 
to 7 in other two regions. Further, provided ^^(y)'s are not capacity achieving, and they are designed for 
asymptotic case (infinite /c) and may not be employed in practice where k is finite. 

Authors in [3J have proposed Growth codes, which are designed to increase the number of recovered 
Xj% in intermediate range in wireless sensor networks. In Growth coding, S gradually increases the degree 
of Cj's on-the-fly based on the value of z (which is known to S by feedbacks received from such that 
the instantaneous decoding probability of each delivered q is maximized. Growth codes only consider 
the instantaneous recovery probability of each q, thus they do not have a close to capacity performance. 
More importantly. Growth codes require a lot of feedbacks from the receiver. 

Authors in [4J have proposed to employ multiple feedbacks to transmit q's in the order of their degree 
to increase the intermediate recovery rate. Since the decoding of Cj's with lower degrees depends on 
the recovery of a smaller subset of Xj's, they have a higher probability of decoding an Xj in D at the 
beginning of transmission. Consequently, an improvement is observed in the intermediate recovery rate of 
LT codes. However, the algorithm proposed in flU cannot outperform the code of [l3]|, Jll in intermediate 
range. Besides, we show that our proposed algorithm always surpasses the algorithm in BU. 

In our recent work [5|, we have designed several ^^(y)'s for LT codes to obtain optimum intermediate 
performance throughout the intermediate range rather than a single 7 [i2J. The LT codes designed in [5l 
do not require channel information or feedbacks in contrast to |l3l, JH. However, similar to [|2l the codes 
designed in Q cannot achieve channel capacity. 

III. The Proposed Algorithm 

A. Discussion and Idea 

In the previous section, we observed a trade-ojf between being channel capacity achieving and having a 
high intermediate recovery rate. Some LT codes have optimum intermediate performance but they cannot 
achieve channel capacity Q, [|2||. On the other hand, the algorithms that are proposed to improve the 
intermediate recovery rate of LT codes with close to channel capacity such as 01 cannot outperform 
codes of the first group in intermediate range. 

The reason for this trade-off is that the codes in the first group have Vt{yy% that result in generation of 
a large fraction of low-degree Cj's. Low-degree Cj's have a higher probability of decoding a source symbol 
when z is small. However as z grows, some of the received Cj's become redundant and cannot recover 
any Xj due to earlier recovery of all their adjacent Xj's. Therefore, these codes cannot have a close to 
channel capacity performance. 

On the other hand, f2(?/)'s of codes with close to channel capacity performance result in generation of 
Cj's with much higher degrees. Decoding of high-degree Cj's depends on the recovery of many Xj's at D, 
thus in intermediate range these Cj's are mostly buffered for a later decoding. Therefore, for these codes 
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z does not grow considerably with 7. However, the buffered high-degree Cj's are simultaneously decoded 
together and recover x at '^succ^ which makes the code capacity achieving. 

We can see that in LT codes with capacity achieving performance, each Cj eventually decodes close to 
one x,j on average, since all k x/s are decoded from k'jsucc q's, which are slightly more than k symbols. 
Consequently, if q's are transmitted in the order that they are decoded, we can significantly improve the 
intermediate recovery rate of capacity achieving LT codes. We propose our algorithm to transmit q's in 
this correct order for two cases of constant and varying e. 

B. Algorithm for Constant e 

Similar to [6], we assume that an estimate of the channel erasure rate, e, is available at 5". Since we 
assume that D generates no feedbacks, our algorithm is designed to be implemented on the encoder side. 
Therefore, our algorithm can exploit the information available in S only, and the decoder remains intact. 

In conventional LT coded symbol transmission, S generates m = ^Isi^^ random Cj's from a capacity 
achieving degree distribution such as Robust-Soliton degree distribution [IJ. After transmission, D 
receives k^succ encoded symbols, which results in a successful decoding of x. This method has a poor 
intermediate recovery rate as we later show. 

In our proposed scheme, after generating m Ci's, S performs as follows. S maintains a probability 
vector p = [p(l), p(2), . . . , p{k)], in which p{j) represents the probability that xj is still not recovered at 
D. Clearly, S sets p to an all-one vector when the transmission has not started yet since no Xj is recovered 
at D. At each transmission and based on p, S finds a Cj that has the highest probability of recovering an 
Xi at D (as we later describe in Algorithm [T]). Next, S transmits q and updates p{j),j E M{ci), where 
M{ci) represents the set of indices of x/s XORed together to generate Cj. S continues until all m q's are 
transmitted. 

An encoded symbol q with degree d, i.e., |A/'(cj)| = d, where |.| represents the cardinality of a set, 
can recover a source symbol Xj iff all Xk,k E {A/'(cj) — j} has already been recovered. Let pdec = 
{P(iec(l),Pdec(2), . . . ,Pdec{n^)}, whcrc Pdec{i) is the probability that c, can recover a source symbol at D, 
and Pdec{i) = if q has been previously transmitted. Since at the beginning of transmission no source 
symbol is still recovered, we have Pdedi) = if |A/'(cj)| > 1, i.e., c/s with degrees larger than one cannot 
decode any Xj at D. Besides, for |A/'(q)| = 1 we have Pdec{i) = (1 — i-e- only degree-one encoded 
symbols that are not erased by the channel (with probability (1 — e:)) can recover a source symbol. 

We can see that at the beginning of transmission degree-one Cj's have the highest probabilities of 
decoding an Xj at D. Therefore, S transmits degree-one q's with N{ci) = {j}, and updates p(j) = 
epoidii), where Poid{j) is the value of p{j) before Cj was transmitted. 

Next, we consider a degree-two Ci,Af{ci) = {j,k}. Ci can recover xj with probability (1 — e:)(l — 
p(j))p(k), which is the probability that Cj is not dropped on channel, Xj has not been recovered previously, 
and the x^ has already been recovered. Similarly, Cj can recover x^ with probability (1 — e){l — p{k))p{j). 
Consequently, Pdec{i) = (1 - - p{k))p{j) + (1 - p{j))p{k)]. Assume \/l i,Pdec{i) > PdeS), i-e. 
Cj has the highest probability of decoding an Xj at D. Therefore, S transmits Cj next and sets p(j) = 
poZd(i)(l - (1 - - poidik))) and p{k) = poid{,k){l - (1 - e){l - poidiJ)))- 

Further, we consider |A/'(cj)| = d. If q is successfully delivered to D, it can possibly decode Xj,j E 
Mi^Ci). Similar to low degree c/s, Xj can be decoded with probability (1 — s)p{i) Y\. ~ P(^))- 

Therefore, pdecif) = (!-£) W) 11 (1 - P(^))]- ^ Pdecif) > Pdec{l),yi i, S transmits q 

and updates p(j) = Poidij)[l - (1 - U (1 - Poidiv))],j E 7V(q). 

We summarize our proposed sorting scheme in Algorithm [T] The output of Algorithm [T] is the suitable 
rearranged transmission order tt of q's that substantially improves 2; in < 7 < 1. In this algorithm, 
argmax{pdec) is a function that returns i where Vj 7^ i,Pdec{i) > PdecU)- Further, if q and q both have 
the highest probability of decoding of an xj, i.e., Pdec{l) = Pdedi), then argmax{pdec) returns the index 
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of Cj or c/, whichever has the lowest degree. Further, if Cj and q have equal degrees (similar to degree 
one Cj's at the beginning of transmission), argmax{pdec) randomly returns one of the indices. Clearly, we 
are assigning earlier transmission priority to lower degree symbols, which we later show is important for 
e -> 1. 



Algorithm 1 The proposed symbol sorting algorithm 

Initialize: vr = 0, p = {l}ixfc 
while |7r| < m do 

for j = I to m, j ^ n do 

pUj) = ii-e) E w) n (1 

end for 

i* = argmax{pdec) 

TL = [iL, i*] 
for j E N{ci*) do 

p{j) = Pomm - {I - e) n (1 

end for 
end while 



Our proposed algorithm increases the coding complexity of LT codes from 0{k\ogk) [[U to 0{k'^), 
while it does not deteriorate the decoding complexity. 

Further, in our proposed algorithm all Cj's need to be generated and sorted before the transmission 
can start in contrast to the conventional LT coding where each Cj can be independently transmitted upon 
generation. Therefore, some delays may be introduced. 

However, this delay can be easily eliminated with the following procedure. Clearly, the performance 
of our proposed scheme is independent of a;'s contents and only depends on N'{ci),i e {1,2, .. . , m} 
and TT. Therefore, before the transmission starts, S generates q's from a dummy x, and obtains an off- 
line version of vr^g-.u^g. S saves A/'off.iine(cj), and Tr^ff.jjng for a later use. When the actual encoding starts, 
X of interest replaces the dummy x, and S generates m Cj's in the order dictated by TLoff-iine' ^ORing 
Xj,j e A/'off-iine (ci)- In this way, each q can be transmitted upon generation and the delay is completely 
eliminated at the cost of some data storage. 

In the next section, we extend Algorithm [T] to the case where e varies. 

C. Algorithm for Varying e 

Assume that S has generated m q's considering e. Assume that the erasure rate of the channel changes 
to Enew whcn symbols has already been transmitted so that q's are still remaining to be 

transmitted. 

If Cnew > less than k'jsucc q's would be collected by D, making the full decoding impossible. In 

this case, S generates t = j^)k{'jsucc — 7c) f^^w q's, and adds them to the queue of c/s to be 

transmitted to ensure the delivery of k-jsucc q's to D. Next, S rearranges all q's in the queue according 
to Algorithm [T] and continues the transmission. 

In the second case for Enew < e, S randomly drops 1 — , ^^"^ fraction of remaining q's from the 
transmission queue. This limits the number of delivered q's to k'jsucc, hence the code maintains its close 
to channel capacity performance. 

If the erasure rate of the channel varies several times, the same procedures are followed after each 
change. We assume that Snew is known to S, which can be realized by receiving few feedbacks from the 
receiver. 

Note that the symbol dropping procedure described above is similar to puncturing LDPC ^ and turbo 
codes [8] to achieve a certain higher coding rate for these codes. 
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IV. Evaluation of the Proposed Algorithm 

We emphasize that our proposed algorithm can be applied to an LT code with any degree distribution 
to increase its intermediate recovery rate when e is available at S. The advantage of this algorithm is that 
if the code is capacity achieving, it remains capacity achieving after employing our algorithm. 

To evaluate the performance of our proposed algorithm, we implement it for two well-known LT codes. 
The first code we employ is the LT code used in Raptor codes (911 with degree distribution VL{y) given 
below and k = 1000. Since low error floors cannot be achieved in intermediate range, the precoding phase 
of Raptor codes can be skipped. 

n{y) = 0.00797a; + 0.49357x^ + 0.16622x^ + 0.07265x'' + 0.08256a;'' 
+0.05606a;* + 0.037232;^ + 0.05559a;" + 0.02502a;^'^ + 0.00314a;^''. 

The second code is an LT code with k = 1000 and Robust-Soliton degree distribution [HI with parameters 
c = 0.05 and 6 = 0.01. 

Figures [T]and[2]illustrate the improvement made in z for aforementioned Raptor and LT codes employing 
our proposed sorting algorithm. 




Fig. 1. Improvement made in the intermediate recovery rate of a Raptor code proposed in |[9j| employing proposed algorithms for various 
e's versus 7. 




Fig. 2. Improvement made in the intermediate recovery rate of an LT code [1] employing proposed algorithms for various e's versus 7. 

From Figures [H and [2I we can see a significant improvement in z for both codes. For instance at 7 = 1, 
for the first and the second code we can see 382% and 843% improvement in z, respectively. We can 
observe that the amount improvement depends on the value of e. The rationale behind this is that when 
e decreases our algorithm can estimate the recovery probability of Xj's more accurately, which results in 
a more efficient reordering of Cj's. As e becomes larger, the ordering of q's becomes less accurate. It is 
worth noting that the conventional transmission of LT codes results in the same curve of z regardless of 
e's value. 



6 



A. Upper and Lower Bounds on Algorithm's Performance 

As £ — 7- 1, 5" cannot make a meaningful estimation about the recovery of x/s at D, and p always 
remains an all-one vector. Since in our proposed algorithm, q's with lower degrees have higher priority 
of transmission, for e — 1 our algorithm approaches to the case where c/s are only sorted based on their 
degrees in tt. Consequently, in this case our proposed algorithm boils down to the algorithm proposed in 
BH. As a result, the improvement made by our algorithm is lower bounded by the results of JH. Moreover, 
for £ — )• 0, S" can estimate which x/s are being decoded with a high accuracy, thus more exact tt can be 
acquired, and the intermediate performance approaches the ideal upper bound, i.e., 2 = 7. 

The upper and the lower bounds on our proposed scheme are depicted in Figures [3] and |4] for distribution 
of Raptor and LT codes, respectively. For comparison, we have also provided the recovery rate curves 
of Growth codes [3] and conventional LT transmission for the same codes. Further, the lower bound 
illustrates the performance of the scheme proposed in 




Fig. 3. The upper and the lower bounds on the improvement made by our proposed scheme for Raptor codes f^l, compared to the 
intermediate recovery rate of Growth codes and conventional LT codes. 




Fig. 4. The upper and the lower bounds on the improvement made by our proposed scheme for LT codes |T|, compared to the intermediate 
recovery rate of Growth codes and conventional LT codes. 

Figures [3] and |4] show considerable improvement for intermediate recovery rate of both employed LT 
codes for any value of e. We can see that Growth codes outperform our propose algorithm only for a 
small region of 7, while they cannot have a close to channel capacity performance. 



B. Algorithm's Performance for Varying e 

As described earlier, if e increases, S needs to generate some new Cj's. Assume that S is transmitting m 
Raptor encoded q's (without precoding) generated for e = 0.3. Also assume that e increases to Enew = 0.5 
at 7c = 0.5. Based on our proposed algorithm, S adds t = \0. 57 14:k{'jsucc — 7c)l new c/s to the queue. 
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and updates n accordingly. We have depicted z versus 7 for this case in Figure [51 For comparison, we 
have also depicted z for constant e E {0.3,0.5}. 
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Fig. 5. The intermediate performance of a Raptor code employing our proposed algorithm for the case where e increases from 0.3 to 0.5 
with 7c = 0.5. 

Figure [5] shows that fluctuation in the e is well compensated by our algorithm. Since the newly generated 
Cj's at 7c disturb the original sorting order, a slight degradation in z can also be observed. These new 
Cj's might have been transmitted earlier than 7^ if they were present in the queue from the beginning. In 
spite of all the fluctuation in intermediate performance, the code remains capacity achieving since D can 
collect k'jsucc encoded symbols in total. 

C. Comparison with Fixed-Rate Codes 

Since we assumed that an estimate of the channel loss rate, e, is available at the source, S can employ 
existing fixed-rate codes instead of LT codes to encoded x. Therefore, we need to compare the performance 
of our proposed scheme with the intermediate recovery rate of existing fixed-rate codes. 

Systematic irregular repeat-accumulate (Systematic IRA) codes [fTOl are capacity achieving fixed-rate 
codes on erasure channels, which can provide a high intermediate recovery rate compared to other existing 
fixed-rate codes. Figure [6] shows the intermediate recovery rate of a systematic IRA code with rate R = 0.5 
versus our proposed algorithm employing Raptor codes without precoding for two cases of e = 0.44 and 
e = 0.46 with k = 10000. 
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Fig. 6. The intermediate recovery rate of systematic IRA codes [101 compared to our proposed algorithm employing Raptor codes f9l for 
k = 10000. 

From Figure |6l we can see that the employed systematic IRA code outperforms our proposed scheme 
for small values of 7. This high intermediate recovery is due to the systematic part of these codes which 
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results in transmission of uncoded x_. When the systematic part of the code is being transmitted, each 
delivered Cj is itself a source symbol, hence z and 7 are equal. However, we can observe that when 
the transmission of systematic part ends, z does not increase linearly with 7 anymore and our proposed 
scheme outperforms this code for larger values of 7. Further, as e: — t- 1 the systematic part cannot be 
delivered and the gain from the systematic part is eliminated. In this case, our proposed algorithm always 
outperforms systematic IRA codes. 

Furthermore, fixed-rate codes seriously suffer from their fixed rates since they cannot compensate slight 
variations in e. For instance, we can see that when e is increased from 0.44 to 0.46, z decreases from 
1 to 0.6150 at the end of transmission. However, as observed in Figure |5] our algorithm employed along 
with a Raptor code exhibit good performance in spite of very large variations in e. 

V. Conclusion 

In this paper, we proposed an algorithm to increase the intermediate recovery rate of capacity achieving 
LT codes. In our proposed algorithm, the transmitter exploits the structure of LT encoded symbols, a 
history of previously transmitted encoded symbols, and an estimate of channel's erasure rate to sort the 
transmission order of the encoded symbols to gain a high intermediate recovery rate. 

Using numerical results, we showed that our algorithm can increase the intermediate recovery rate of 
LT codes to a great extent while the code remains capacity achieving. We also showed that this algorithm 
performs well for fluctuating channel erasure rates. 

To extend this work, we intend to implement the proposed algorithm for real multimedia transmission 
and observe the improvement made in the quality of the received stream. 
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